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Summary 

In  solving  deterministic  AI  problems  the  data  base  search  for  matching  the  arguments  of  a 
PROLOG  expression  causes  serious  bottleneck  when  implemented  sequentially  by  electronic 
systems.  To  overcome  this  bottleneck  we  have  developed  the  concepts  for  an  optical  expert  system 
based  on  matrix-algebraic  formulation,  which  will  be  suitable  for  parallel  optical  implementation. 
The  optical  AI  system  based  on  matrix-algebraic  formulation  will  offer  distinct  advantages  for 
parallel  search,  adult  learning,  etc.  (For  more  details  see  Sect.  2  and  attached  reference  1). 


To  optically  solve  the  AI  problems  which  involve  multiple  arguments  we  have  studied  optical 
architectures  to  implement  vector-tensor  and  matrix-tensor  multiplication.  A  matrix-tensor 
multiplier  can  provide  interconnections  between  2-D  arrays  of  processors  and  2-D  arrays  of 
memory  cells.  Conventionally,  a  matrix-tensor  multiplier  is  based  on  space  multiplexing,  therefore, 
requiring  extremely  large  space-bandwidth  product  from  the  optical  channel.  We  have  devised  a 
matrix-tensor  multiplier  based  on  random  phase  coding  and  multiplexing,  and  evaluated  and 
compared  the  performance  characteristics  of  the  random  phase  coded  matrix -tensor  multiplier  with 
those  of  a  conventional  one.  The  comparison  shows  that  there  exists  a  trade-off  between  the 
dynamic  range  requirements  of  the  system  and  the  space-bandwidth  product  required  by  the  optical 
channel,  and  that  the  phase-coded  matrix  tensor  multiplier  will  reduce  the  space  bandwidth  product 
requirements  for  reasonable  dynamic  range  requirements.  (For  more  details  on  the  matrix-tensor 
multiplier  performances  see  Sect.  3  and  Reference  2). 


In  the  development  of  programmable  interconnect  for  optical  AI  and  NI  systems,  we  have 
investigated  the  storage  properties  of  various  photorefractive  crystals.  We  have  found  that  in 
SBN:60  crystals  the  available  charge  carriers  may  be  very  efficiendy  used  to  store  a  large  number  r 
(e.g.,  -  450-600  patterns)  of  interconnection  patterns.  (For  more  details  see  Sect.  4.) 
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1 .  Introduction 


During  the  last  six  months  we  have  been  studying  the  existing  parallel  computing  architectures 
for  Artificial  Intelligence  (AI)  and  Neural  Intelligence  (NI)  in  order  to  advantageously  apply  optical 
interconnects  and  to  design  more  flexible  systems  based  on  space-time  tradeoffs.  We  have  been 
investigating  different  relevant  topics  such  as  the  paracomputer,  shared  and  distributed  memory, 
reconfigurability  of  optical  interconnect,  routing  of  optical  signals,  parallel  algorithms  for  sorting 
and  vector-matrix  multiplications,  etc. 

In  the  next  section  we  will  briefly  describe  the  new  approach  for  mapping  AI  problems  on 
optical  processing  architectures,  where  we  show  that  typical  AI  operations  such  as  search  and 
unification  can  be  performed  in  parallel  using  optical  processing  by  devising  a  new  matrix  algebraic 
formulation.  In  Sect.  3  we  will  describe  a  new  approach  in  implementing  programmable  optical 
interconnect  by  employing  a  matrix-tensor  multiplier  based  on  random  phase  coding  and 
photorefractive  crystals.  In  Sect.  4  we  will  discuss  the  results  of  our  studies  on  storage  properties  of 
photorefractive  crystals  and  their  use  in  programmable  architectures  for  AI  and  NI  applications. 

2.  Optical  Expert  System  Based  on  Matrix-algebraic  Formulation 

The  data  base  search  for  matching  the  arguments  of  a  PROLOG  expression  encountered  in 
solving  deterministic  AI  problems  (such  as  those  encountered  in  expert  systems)  often  causes 
serious  bottlenecks,  when  it  is  performed  serially  by  sequential  electronic  machines.  The  reasons  of 
this  bottleneck  arise  from  the  exponential  nature  of  the  serial  search  process,  which  can  be 
alleviated  by  parallel  search.  Several  optical  architectures  exist  for  performing  matching  operations 
in  parallel.  Perhaps  one  of  the  most  time  efficient  optical  architecture  for  parallel  matching  is  that 
of  the  vector-matrix  multiplier,  whose  input  can  be  the  query  vector  and  the  matrix  can  be  the  fact 
matrix.  Hence,  in  our  matrix  algebraic  formulation  each  fact  relating  to  two  arguments  will  be 
encoded  into  a  binary  matrix.  Different  facts  relating  to  different  pairs  of  arguments  will  be 
encoded  into  different  binary  matrices.  New  facts  can  be  generated  by  performing  matrix-matrix 
multiplications  and  2-D  logic  operations.  Therefore,  optical  AI  systems  based  on  matrix-algebraic 


formulation  offer  distinct  advantages  for  adult  learning  over  serial  PROLOG  based  expert  systems 
More  details  about  optical  expert  systems  based  on  our  new  formulation  can  be  found  in  the 
attached  reference  1 . 

Promising  as  the  matrix-algebraic  formulation  may  be,  we  recently  found  also  that  when  the 
number  of  objects  that  are  related  by  the  same  fact  increases,  the  space  bandwidth  product  of  the 
optical  vector-matrix  multiplier  will  also  have  to  be  increased  and  may  become  a  limiting  factor. 
To  solve  those  AI  problems  whose  facts  contain  more  than  two  arguments  we  have  been  studying 
optical  architectures  for  vector-tensor  and  matrix -tensor  multiplications. 

3.  Matrix-tensor  Multiplication  by  Random  Phase  Coding 

A  matrix-tensor  multiplier  can  be  employed  to  provide  interconnections  between  a  2-D  array 
of  processors  and  a  2-D  array  of  memory  cells  in  similar  ways  as  a  vector-matrix  multiplier, 
providing  interconnections  between  1-D  arrays.  To  reduce  the  space-bandwidth  product 
requirement  of  the  matrix-tensor  multiplier  we  studied  the  incorporation  of  random  phase  codes 
into  the  matrix  and  tensor  components.  We  evaluated  the  performance  characteristics  of  the 
random  phase  coded  matrix-tensor  multiplier  and  compared  them  to  those  of  a  conventional  one 
based  on  space  multiplexing  (see  Figs.  1,  2).  This  comparison  shows  that  there  exists  a  trade-off 
between  the  dynamic  range  requirements  of  the  system  and  the  space-bandwidth  product  required 
by  the  optical  channel.  For  reasonable  dynamic  range  requirements  the  phase  coded  approach  to 
matrix-tensor  multiplication  can  reduce  the  space-bandwidth  product  requirements.  More  details 
on  our  phase-coded  matrix-tensor  multiplier  can  be  found  in  the  attached  reference  2. 


4.  Programmable  architectures 

A  parallel  processing  system  with  programmable  architectures  for  AI  and  NT  will  require 
storage  of  large  capacity  to  store  the  interconnection  patterns.  In  our  attempt  to  develop  such 
storage  systems  we  used  the  experimental  setup  of  Fig.  3  to  study  the  storage  properties  of  various 
photoreffactive  materials.  We  investigated  the  dependence  of  the  write  and  erase  time  response 
asymmetry  (see  Fig.  4)  on  different  parameters  (e.g.,  applied  electric  field,  input  intensity,  crystal 
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thickness,  etc.)-  The  photorefractive  response  time  for  both  writing  and  erasing  a  diffraction  grating 
in  a  3mm  thick  crystal  of  SBN:60  as  a  function  of  applied  electric  field  is  shown  in  Fig.  5.  The 
ratio  (R)  of  the  photorefractive  erase  time  over  write  time  is  plotted  in  Fig.  6  as  a  function  of  an 
externally  applied  electric  field.  We  found  that  an  asymmetry  of  almost  30  was  reached  at  8 
kV/cm.  This  asymmetry  could  be  further  enhanced  by  increasing  the  input  writing  beams  intensity 
and  the  thickness  of  the  crystal.  The  larger  the  asymmetry  is,  the  larger  is  the  number  of  holograms 
that  can  be  stored  in  the  the  photorefractive  crystals.  In  our  preliminary  experiments  we  have 
stored  30-40  planes  of  2-D  information  using  a  crystal  providing  a  ratio  R  =  2.  Assuming  that  this 
asymmetry  results  from  a  more  efficient  use  of  the  available  charge  carriers,  we  expect  that  the 
memory  capacity  of  such  crystals  can  be  increased  to  450-600  planes  of  information. 

5.  Conclusions  and  Further  Directions 

During  the  past  six  months  we  have  devised  a  new  optical  expert  system  based  on  matrix 
algebraic  formulation  and  suitable  for  parallel  optical  implementation.  We  are  continuing  the  study 
of  our  matrix-algebraic  formulation  for  AI  by  finding  the  relations  between  the  fact  matrices  and 
rules  so  that  sparse  or  infrequently  used  fact  matrices  can  be  incorporated  into  rules  to  save  memory 
space.  This  approach  will  also  be  compared  to  other  parallel  AI  knowledge  base  systems  that  use 
matrix  formulations. 

We  have  also  developed  a  new  approach  to  implement  programmable  optical  interconnect  by 
employing  a  matrix-tensor  multiplier  based  on  random  phase  coding  and  compared  its 
performances  to  those  of  a  conventional  one  based  on  space  multiplexing.  We  are  presently 
implementing  experimentally  the  phase  coded  matrix-tensor  multiplier  using  dichromatic  gelatin 
and  photorefractive  crystals. 

In  our  development  of  optical  storage  for  programmable  (interconnect)  architecture  we  have 
studied  the  storage  properties  of  different  photorefractive  materials  and  predict  that  in  SBN:60  the 
available  charge  carriers  can  be  very  efficiently  used,  therefore  allowing  very  large  storage  capacity 
(i.e.,  -  450-600  inteconnection  patterns).  We  arc  currently  investigating  the  maximum  storage 
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Figure  3.  An  experimental  set-up  designed  to  measure  the  write  time  and  erase  response  time 
characteristics  of  photorefractive  materials,  the  first  pair  of  plane  waves  from  the 
argon  laser  is  used  to  write  a  grating  in  the  photorefractive  crystal.  A  HeNe  beam 
which  is  Bragg-matched  to  this  grating  is  then  partially  diffracted  into  a  photodiode, 
whose  output  is  stored  in  a  chart  recorder.  This  way  the  grating’s  presence  can  be 
continuously  monitored.  The  grating  is  then  erased  by  blocking  the  first  beam  pair 
and  immediately  illuminating  the  crystal  with  a  second  pair  of  beams  from  the  argon 
laser.  A  new  grating,  for  which  the  HeNe  beam  is  not  Bragg  matched,  is  written  in 
the  crystal,  eventually  replacing  the  first  grating.  The  write  and  erase  times  are 
direcdy  measured.  The  ratio  of  the  erase  time  to  the  write  time,  R,  can  then  be 
calculated. 

The  intensities  of  each  of  the  four  argon  laser  beams  are  unifrom  across  the  crystal 
surface  and  equal  to  one  another  to  within  5%.  The  crystal  is  held  between  two 
electrodes  and  immersed  in  high  voltage  oil  to  prevent  arcing  between  the  electrodes. 
The  field  is  applied  parallel  to  the  grating  vector  of  the  primary  grating.  Reversing 
the  direction  of  the  field  did  not  significantly  affect  the  result.  The  face  of  the  crystal 
was  normal  to  the  primary  beam  pair.  Rotating  the  crystal  by  up  to  ten  degrees  in 
either  direction  did  not  significantly  alter  R,  although  the  overall  diffraction  efficiency 
was  reduced.  The  time  required  to  switch  between  beam  pairs  much  less  than  the 
response  times  observed.  The  intensity  of  the  HeNe  beaem  used  to  read  the  grating 
was  small  compared  to  the  Ar  writing  beams,  so  that  erasure  of  the  grating  by  the 
reading  beam  was  negligible. 
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Figure 


4.  A  typical  write -erase  time  cycle  of  a  3mm  thick  SBN:60  crystal,  measured  at  different 
values  of  externally  applied  electric  field  parallel  to  the  grating  wavevector.  The 
asymmetry  in  write  and  erase  time  is  enhanced  by  the  externally  applied  electric  field. 

5000  it  *  *  *  i  *  *  *  *  i  *  *  *  *  i 


4000 


a  :  write  time 
■  :  erase  time 


3000 


§  2000 


O  | 

1000 


Figure  5. 
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The  photoreffactive  response  time  for  both  writing  and  erasing  a  diffraction  grating  in 
a  3  mm  thick  crystal  of  SBN:60  is  plotted  as  a  function  of  externally  applied  electric 
field.  The  intensity  of  each  of  the  light  beams  was  750  mW/cm2.  The  erase  time 
increases  to  a  peak  at  5  kv/cm,  then  decreases,  while  the  write  time  decreases 
monotonically  with  applied  field. 
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Figure  6. 


The  ratio,  R,  of  the  photoreffactive  erase  time  over  the  write  time  is  plotted  as  a 
function  of  applied  field  for  a  3  mm  thick  crystal  of  SBN:60.  A  peak  value  of  almost 
thirty  was  reached  at  8  kV/cm.  This  asymmetry  should  result  in  a  corresponding 
increase  in  the  number  of  image  planes  which  can  be  simultaneously  stored  in  the 
volume  of  the  crystal.  Date  Started:  5-24-88 
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Abstract 

This  paper  describes  an  expert  system  paradigm  based  on  matrix  algebra.  The 
knowledge  base  of  the  expert  system  is  stored  in  binary  matrices,  while  the  learning  and 
the  inference  processes  are  done  by  matrix  algebra  operations.  This  method  is  highly 
parallel  and  can  take  full  advantage  of  the  inherent  parallelism  and  connectivity  of  optics. 
An  opto-electronic  architecture  that  implements  this  system  is  presented.  In  addition,  the 
method  is  compared  to  the  sequential  search  methods  written  in  the  programming 
language  Prolog  in  order  to  illustrate  their  differences  and  commonalities. 

1.  Introduction 

Artificial  intelligence  (AI)  is  a  field  concerned  with  the  simulation  of  intelligent 
behavior[l].  Expert  systems  have  been  one  of  the  most  successful  applications  of  AI[2]. 
Expert  systems  encode  knowledge  in  the  knowledge  base  and  perform  intelligent  interac¬ 
tions  with  it.  Therefore,  knowledge  representation  has  become  a  fundamental  problem  in 
AI.  One  approach  to  knowledge  representation  is  the  use  of  semantic  networks  (see  Fig¬ 
ure  1  for  an  example),  where  the  relations  (or  attributes)  between  objects  and  values  (e.g. 
Mary,  football,  etc.)  are  described  by  a  directed  graph  consisting  of  nodes  and  labeled 
edges  (e.g.  Likes  and  Member).  To  store  a  semantic  network,  conventional  electronic 
expert  systems  use  a  tuple  ordered  set  (attribute,  object,  values)  .  Many  of  these  expert 
systems  are  based  on  the  production  system  paradigm[3-4],  where  facts  and  rules  consti¬ 
tute  a  knowledge  base.  Facts  define  the  relationships  between  objects,  and  rules  define 


the  procedures  for  deriving  new  relations  from  existing  ones.  Prolog  is  a  popular  AI 
language  that  implements  the  production  system  paradigm[5]. 

Conventional  electronic  expert  systems  sequentially  search  the  knowledge  base  for 
the  appropriate  facts  and  rules  in  order  to  find  solutions  to  a  query.  The  use  of  these 
electronic  systems  to  solve  symbolic  logic  problems  has  been  limited,  due  to  the  ineffi¬ 
ciency  of  such  massive  searches.  To  support  numerous  AI  applications,  more  powerful 
computing  machines  capable  of  performing  a  massively  parallel  search  are  needed. 
Parallel  search  allows  an  expert  system  to  find  solutions  efficiently  because  all  the  poten¬ 
tial  solutions  are  considered  simultaneously.  Some  systems  that  perform  symbolic  com¬ 
puting  and  inference  utilizing  the  parallelism  and  connectivity  of  optics  have  recently 
been  presented.  For  example,  Eichmann  and  Caulfield[6]  proposed  an  optically  assisted 
expert  system  using  optical  spatial  light  modulators(SLMs)  to  store  knowledge.  Warde 
and  Kottas[7]  described  two  query-driven  hybrid  optical  inference  machines.  One  was 
based  on  the  conventional  matched-filter  concept,  which  is  similar  to  the  optical  correlo- 
graph  system  described  by  Willshaw  and  Longuet-Higgins[8].  The  other  used  mapping 
templates  to  store  the  relationships  between  objects;  conclusions  to  the  query  are  inferred 
by  applying  these  mapping  templates  to  objects  in  the  order  prescribed  by  the  rules.  Szu 
and  Caulfield[9]  generalized  the  prior  work  by  representing  the  knowledge  in  an  associa¬ 
tive  memory  matrix  and  storing  data  explicitly  in  a  2-D  outer  product  matrix  so  that  logic 
inference  could  be  performed  at  an  extremely  fast  rate. 

In  this  paper,  we  attempt  to  formulate  an  expert  system  paradigm  based  on  matrix 
algebra  in  a  form  which  is  more  suitable  for  optical  implementation.  Key  issues  related 
to  this  expen  system  paradigm,  including  knowledge  representation,  learning  capability 


and  the  inference  engine  will  be  discussed  in  Sections  2  and  3  respectively.  A  com¬ 
parison  of  the  proposed  method  with  sequential  search-based  methods  written  in  the  pro¬ 
gramming  language  Prolog  is  provided  to  illustrate  the  differences  and  commonalities 
betw-een  them.  We  base  our  comparison  on  sequential  Prolog  because  it  is  currently  one 
of  the  most  widely  used  programming  language  in  the  A1  community,  although  parallel 
versions  of  the  language  are  available.  In  Section  4,  we  will  present  (as  an  example)  a 
maze  search  problem  to  show  the  parallel  processing  nature  of  the  matrix  encoding 
method.  An  optical  architecture  for  the  implementation  of  the  proposed  expen  system 
paradigm  is  described  in  Section  5.  Section  6  concludes  the  presentation. 

2.  Know  ledge  representation  of  facts  and  rules 

Knowledge  representation  is  a  key  issue  in  the  design  of  a  knowledge-based  expert 
system.  It  will  affect  the  architecture  of  the  system  as  well  as  the  efficiency  of  knowledge 
retrieval  from  the  system.  In  this  Section  we  describe  a  matrix  encoding  method  for 
knowledge  representation,  where  facts  of  relations  among  objects  are  encoded  in  binary 
matrices,  and  rules  are  manipulated  in  matrix  algebraic  form. 

2.1  Matrix  encoding  of  facts 

Let  R "  and  R ”  be  two  sets  of  objects, 


where  x,  and  yj  are  objects  in  R%  and  Rf,  respectively.  If  the  objects  in  R"  are  related  to 
the  objects  in  Rf,  then,  their  relationships  can  be  described  by  a  set  of  facts.  In  logic  for- 


-si¬ 


mulation,  a  fact  with  two  arguments  can  be  seen  as  a  binary  function  of  the  tw  o  related 
objects;  that  is,  if  the  relationship  between  x,  and  v,  is  rrue,  then  fact  (x{,  \j)  =  1,  other¬ 
wise  fact(Xj ,  }'j)  =  0.  In  our  matrix  encoding  method,  facts  of  the  same  relationship  (i.e. 
all  the  tuples  with  the  same  attribute)  are  encoded  in  a  binary  matrix.  If  fact  (x,,  yj)  =  1 
(true)  or  fact  (x,  ,  _v;)  =  0  (false),  then  the  matrix  element  [Ftj],  at  the  i-th  row  and  the  j-th 
column  of  matrix  F  (R ".R"'),  is  equal  to  1  or  0,  respectively;  i.e. 

f  1  rrue 

[ Fjj  ]  =  fact (Xj,yj)  =  |  0  faise  x,eRnx,  yjzRny'\  (2) 

or 


ryi  y 2 


*i 

*2 


F(Rnx,R?)  =  . 


(3) 


where  F(R”,Ry)  (or  F  for  short)  is  called  the  fact  matrix  for  a  certain  relation  between 
R"  and  Rf .  For  example,  we  illustrate  in  Figure  1  a  semantic  network,  where  a  node 
defines  either  the  object  or  its  value,  and  an  arrow  indicates  the  relationship  between 
object  and  value.  Based  on  our  proposed  matrix  encoding  method,  the  semantic  network 
of  Figure  1  can  be  hilly  described  by  the  matrices  L  (for  relation  Likes)  and  M  (for  rela¬ 
tion  Member), 


John  Mary  David  Ann 


John  1 
L  =  Mary  0 
David  0 
Ann  1 


0  0 
1  1 
0  1 
0  0 


1 

0 

0 

1 


(4) 
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footbaU  baseball  tennis 


John 
M  =  Mary 
David 
Ann 


1 

0 

0 

0 


0 

0 

1 

0 


0 

1 

0 

1 


(5) 


It  is  useful  to  note  that  the  likes  relation  matrix(L)  is  a  square  matrix  and  relates  objects 
of  the  same  set  R*  =  /?*  =  {  John,  Mary,  David,  Ann  )  to  one  another,  while  the  Member 
matrix(M)  is  a  rectangular  matrix  and  relates  objects  in  two  different  sets,  R*  =  {  John, 
Mary',  David,  Ann  |  and  R*  =  {  football,  baseball,  tennis  },  to  one  another. 

2.2.  Matrix  algebraic  formulation  of  rules 

The  other  important  element  of  a  knowledge  base  in  an  expert  system  consists  of 
rules,  which  can  be  used  to  generate  facts  for  new  relations  from  given  or  already  known 
facts.  We  may  consider,  in  general,  that  a  rule  is  a  function  of  facts.  A  new  fact  can  be 
concluded,  from  the  function,  through  a  sequence  of  logic  operations  applied  to  the 
known  facts.  In  the  matrix  encoding  method,  logic  operations  between  relations  are  car¬ 
ried  out  by  thresholding  the  matrix-matrix  product,  for  the  AND  operation,  and  by  thres¬ 
holding  the  matrix-matrix  sum,  for  the  OR  operation.  Therefore  in  this  paper,  all  the 
matrix  algebra  operations  presented  are  followed  by  an  implicit  threshold  operation.  For 
example,  given  three  matrices  A(R"),  B  (R™)  and  C(R1,)  of  known  facts,  if  a  rule  says 
that  "M  is  true  if  C  is  true  or  both  A  and  B  are  true",  then  this  rule  can  be  formulated  in 
matrix  algebra  form. 


M(Rnx,R[)  =  C  (R”,Rlz) +A(R",Ry)-B  (R?,Rlz), 


(6) 


where  M  is  the  fact  matrix  of  a  new  relation.  As  another  example,  let  us  define  the 


following  rule: 

If  (x  Likes  y)  and  (y  is  a  Member  of  the  z  team), 
then  x  may  like  to  Watch  z  game. 


The  new  relation  Watch(\V )  for  x  and  r  is  true,  if  both  relations  Likes(L)  for  x  and  y  and 
Member(M)  for  y  and  z  are  true.  In  matrix  algebraic  formulation,  the  fact  matrix  W  can 


be  generated  from  L  in  Eq.(4)  and  M  in  Eq.(5)  by  a  matrix-matrix  multiplication  opera¬ 
tion;  i.e. 


i  oo  r 
0110 

1  00  ' 
001 

John 

football  baseball  tennis 

1  0  1 

L-M  - 

00  10 

100  1 

0  1  0 

00  1 

=  Mary 

David 

Ann 

0  1  1 

0  1  0 

1  0  1 

(7) 


It  should  be  noted  that  all  the  new  facts  for  the  same  relationship  are  generated  simul¬ 


taneously  in  parallel  by  a  matrix-matrix  multiplication,  and  are  encoded  in  a  single 


matrix,  even  though  only  some  of  the  new  facts  may  be  needed  to  solve  the  problem. 


This  is  different  from  most  conventional  expert  systems,  where  only  the  needed  facts  are 
generated  one  at  a  time. 


2.3  Comparison  with  Prolog 

A  Prolog  expert  system  stores  and  processes  all  the  facts  separately.  Consider  the 
facts  of  relationships  Likes  and  Membership  in  the  preceeding  examples.  The  Prolog 
code  for  these  facts  is: 


Likes(John,  John) 
Likes(John,  Ann) 
Likes(Mary,  Mary) 


Likes(Mary,  David) 

Likes( David.  David) 

Likes(Ann,  John) 

Likes(Ann,  Ann) 

Member(John.  football) 

Member(Mary,  tennis) 

Member(David,  baseball) 

Member(Ann,  tennis) 

Only  the  facts  for  which  the  relationship  is  true  are  stored  in  the  knowledge  base.  In  con¬ 
trast,  in  the  matrix-algebra  encoding  method  all  the  facts  (true  or  false)  of  the  same  rela¬ 
tion  are  stored  in  a  single  binary  matrix.  All  the  facts  stored  in  the  same  matrix  are  later 
processed  simultaneously. 

The  number  of  arguments  in  a  fact  can  be  arbitrary.  For  example,  the  fact 
"Gives(John,  Mary,  book)"  has  three  arguments.  In  Prolog,  the  processing  time  increases 
with  increasing  number  of  arguments.  In  contrast,  in  matrix-algebra  encoding  method 
the  number  of  arguments  in  a  fact  will  determine  the  rank  of  a  tensor,  which  stores  the 
fact  (e.g.  two  arguments  determines  a  second  rank  tensor  which  is  a  matrix).  Therefore, 
the  matrix  encoding  is  capable  of  operating  on  more  than  two  arguments,  but  at  the 
expense  of  an  increase  in  space  complexity. 

In  Prolog  conclusions  are  derived  from  rules  sequentially  by  asserting  the  left  side 
of  a  rule  whenever  all  the  relations  on  the  right  side  of  the  rule  can  be  unified.  For  exam¬ 
ple,  the  rule  for  Watch  given  earlier  translates  into: 

Watch(x,z) Likes(x,y),  Member(y,z) , 

and  a  new  fact  Watch  between  x  and  z  is  asserted,  if  prolog  find  that  both  the  facts 
Likes  ( x,y )  and  Member  (y,z)  are  true  for  some  objects  x,  y  and  z.  This  derivation  is  done 


by  sequentially  searching  the  knowledge  base  for  every  matching  solution.  In  addition, 
the  newly  derived  facts  are  usually  not  saved  to  avoid  increasing  the  knowledge  base  and 
the  search  time  to  find  the  solution.  In  contrast,  with  the  matrix  encoding  method  all  the 
conclusions  are  generated  simultaneously  and  can  be  saved  without  extra  overhead  in 
search  time  as  showfn  in  Eq.(7). 

3.  Learning  and  the  inference  engine 

In  an  expert  system,  inference  is  the  process  to  find  a  solution  to  a  query,  while 
learning  is  the  process  of  updating  the  knowledge  base.  Conventional  electronic  expert 
systems  use  sequential  search  with  unification  (e.g.  pattern-matching  process)  to  perform 
inference  and  learning.  In  this  section  a  parallel  scheme  is  described,  based  on  the  matrix 
encoding  method  that  updates  the  knowledge  base  and  answers  queries. 

3.1.  Learning:  a  dynamic  knowledge  base 

In  a  matrix-algebra  based  expert  system,  learning  can  be  implemented  simply  by 
using  rules,  where  new  relations  can  be  generated  from  known  relations  and  facts  in  the 
knowledge  base.  As  shown  in  Eq.(7),  given  known  relations  Likes  (L)  and  Member  (M), 
the  new  relation  Watch  is  learned  by  performing  matrix-matrix  multiplication.  An  optical 
matrix-matrix  multiplier  can  offer  much  help  in  speeding  up  the  learning  of  such  an 
expert  system. 

In  special  cases  when  an  existing  relation  has  to  be  updated. 


a  gain  matrix  of  learning  G  is  required  as  illustrated  by  the  following  example.  The  fol¬ 
lowing  rule 


If  x  Likes  "Mary",  then  "John"  Likes  x, 
can  be  expressed  in  matrix  algebraic  formulation  by 


John  Man ’  David  Ann  ^  John  Mary  David  Ann 

John  1111  John  0100 

Mary  0  0  0  0  =  Man  0  1  0  0  G  (9) 

David  0  0  0  0  David  0  10  0 

Ann  0  0  0  0  Ann  0  10  0 


D 

m 

*S»ll 

$ 

A 


On  the  right-hand  side  of  Eq.(9)  the  matrix  indicates  that  ”x  Likes  Mary"  and  x  could  be 
John,  Mary,  David  or  Ann,  while  on  the  left-hand  side  of  the  equation  the  matrix  indi¬ 
cates  that  "John  Likes  x".  Therefore,  the  gain  matrix  G  is  needed  to  equate  those  two 
matrices.  Alternatively, G  can  be  found  simply  by  putting  "1"  in  the  intersection  of  the 
second  row  and  the  first  column,  which  corresponds  to  the  objects  "Mary"  and  "John" 


respectively;  i.e. 


0  0  0  0  ‘ 
1000 
0000  • 
0000 


After  evaluating  Eq.(8),  using  LM  from  Eq.(4)  and  the  gain  matrix  G  from  Eq.(9),  we 
obtain  a  new  fact  matrix  for  the  relation  Likes;  that  is 


m 

m 

i® 


John  Mary  David  Ann 
John  110  1 

L new  =  Mary  011  0 

David  0  0  1  0 

Ann  10  0  1 


-  10- 


Comparing  the  new  fact  matrix  given  in  Eq.(10)  with  the  old  fact  matrix  given  in  Eq.(4), 
it  is  clear  that  the  relation  Likes  has  been  updated  by  a  new  fact  "John  Likes  Mary". 

3.2  Inference  engine 

The  inference  engine  finds  a  solution  to  a  query  by  retrieving  information  related  to 
the  object  x,  from  the  knowledge  base.  If  the  information  (e.g.  fact)  is  not  immediately 
available,  the  matching  rules  are  tried  in  order  to  conclude  the  query.  The  above  descrip¬ 
tion  can  be  summarized  in  short  syntax  form  as 

solution  query  ( x,  facts,  rules  ). 

In  the  matrix  encoding  method,  retrieving  from  the  matrix  F  a  certain  fact  related  to  the 
object  Xi  is  achieved  through  the  following  vector-matrix  multiplication 

y  =x-F, 

where  y  (=<y  iO’2»-.>’»n>)  is  the  solution  vector,  and  x  (=<xi,X2,..,x„>)  is  the  query 
vector.  Both  x  and  y  are  binary  (0  or  1)  vectors.  If  F  encodes  the  facts  of  relationship 
between  R"  and  Rf,  each  element  of  x  corresponds  to  one  object  in  R ",  while  each  ele¬ 
ment  of  y  corresponds  to  one  object  in  Rf.  The  i-th  element  of  the  query  vector  x  is  set 
to  indicate  that  x,  is  the  object  of  interest.  Thus,  if  the  j-th  element  of  the  solution  vector 
y  is  set  after  the  vector-matrix  multiplication  of  x  and  F,  the  relationship  between  x,  and 
yj  is  then  true. 

However,  in  most  cases  the  fact  is  not  immediately  available  in  the  knowledge  base, 
and  a  rule  must  be  employed  in  order  to  conclude  a  query.  Let  us  consider  an  example  of 


performing  inference  in  order  to  answer  the  query: 


What  game  may  "John"  like  to  Watch  ? 

In  this  particular  case,  the  query  vector  is 

John  Mary  David  Ann 

-=<  1  0  0  0  >’  (11) 

and  we  inquire  facts  from  relation  Watch,  i.e.  the  matrix  W.  The  query  can  be  concluded 
by  a  simple  vector-matrix  multiplication,  x-W.  However,  if  the  fact  matrix  W  is  not  yet 
in  the  knowledge  base,  the  rule  given  in  Eq.(7)  must  be  called  to  conclude  the  query;  i.e. 

.  football  baseball  tennis 

y~  =  x-W  =  x-L-M  =  t  j  0  j  j.  (12) 

The  y  vector  indicates  that  the  conclusion  to  the  query  is: 

John  may  like  to  watch  football  and  tennis  games. 


3.3  Comparison  with  Prolog 

It  should  be  noted  that  learning  is  done  by  rules.  In  the  matrix-algebra  based  expert 
system  all  the  learned  facts  are  stored.  Therefore,  one  pays  a  price  in  space  (memory 
storage)  but  gains  in  processing  speed.  Adding  new  relations  may  increase  the  matrix 
size,  without  increasing  the  processing  time.  In  contrast,  in  Prolog  the  new  farts  are  usu¬ 
ally  not  saved.  If  all  the  newly  derived  farts  were  saved  in  Prolog,  the  size  of  the 
knowledge  base  would  increase.  This  would  result  in  a  significant  increase  in  processing 
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Prolog  is  a  backward  reasoning  system,  which  starts  with  the  goal  (query)  and  tries 


to  work  backwards  to  satisfy  the  goal.  It  solves  a  problem  by  sequential  search  and 


pattern-matching.  For  instance,  to  answer  the  query  1-Watch  {John,}  ),  i.e.  what  game 


John  may  like  to  watch?,  Prolog  searches  the  knowledge  base  (facts  and  rules)  for  the 


predicate  Watch  and  matches  the  arguments  step  by  step.  Prolog  also  uses  backtracking 


to  find  all  possible  solutions  to  the  problem.  This  means  that  if  the  pattern-matching  fails 
as  Prolog  searches  through  its  knowledge  base,  then  it  automatically  backtracks  to  its 


previous  step,  resulting  in  a  depth-first  type  of  search.  Therefore,  in  Prolog  the  more 


arguments  and  rules  that  are  used,  the  longer  it  takes  to  solve  the  problem.  In  contrast, 


the  matrix  algebra  based  expert  system  generates  all  the  solutions  to  the  problem  at  one 
time,  even  though  some  of  the  solutions  are  irrelevant  to  the  goal.  The  parallel  nature  of 


optics  eliminates  the  need  for  backtracking  through  the  knowledge  base. 


4.  Case  study:  Searching 


To  illustrate  the  differences,  in  terms  of  knowledge  representation  and  searching 
algorithms,  between  Prolog  encoding  and  the  matrix  encoding  methods,  let  us  consider 
the  problem  of  searching  through  the  maze  shown  in  Figure  2(a).  The  simplest  Prolog 


program  for  solving  this  maze  is 


DR(A3). 

DR(B,E). 

DR(B,C). 

DR(D,E). 

DR(C,D). 

DR(E,F). 

DR(E,G). 


H 

wmmsmmm 


! 

I 

:  GO(XA'). 

:  GO(X.Y) DR(X.Z),  GO(Z,Y). 

|  where  DR  defines  the  door  between  two  rooms,  and  GO(X,Y)  is  a  rule  that  attempts  to 

find  a  path  from  room-X  to  room-Y.  To  find  if  there  is  a  path  from  room- A  to  room-G,  a 
query  ?-  GO(A,G)  is  presented  to  Prolog.  Note  that  this  is  equivalent  to  searching  for  a 
path  between  nodes  A  and  G  in  the  graph  shown  in  Figure  2(b).  Prolog  would  use 
sequential  searching  with  backtracking  to  find  this  path.  Accordingly,  the  time  to  find 
the  path  increases  with  the  number  of  rooms  and  doors  in  the  maze.  The  more  rooms  and 
doors  there  are,  the  longer  it  will  take  for  Prolog  to  find  the  path.  Finding  the  optimum 
(e.g.  shortest)  path  will  require  even  more  time  because  there  could  be  multiple  solutions. 
In  addition,  the  above  Prolog  program  may  get  into  an  infinite  loop  (e.g.  B-C-D-E-B-C- 
D-E-...).  To  avoid  the  looping  problem,  one  can  keep  a  list  of  rooms  visited  so  far  and 
avoid  visiting  the  same  room  twice.  This  list  will  also  give  us  the  path  from  room-A  to 
room-G. 

In  the  matrix  encoding  method,  the  maze  is  encoded  in  a  matrix  D, 


ABCDEFG 
1100000 
1110100 
0  1110  0  0 
0  0  1110  0 
0  10  1  111 
0  0  0  0  1  1  0 
0  0  0  0  1  0  1 


A  recursive  rule  for  GO  is  formulated  as  an  iterative  vector-matrix  multiplication: 


To  indicate  that  the  search  starts  from  room-A,  the  initial  query  vector  would  be 
x(a]  =  <  1  000000  >.  During  the  iterations,  the  following  vectors  are  generated: 

ABCDEFG 


v(0) 

±A 

< 

1 

0 

0 

0 

0 

0 

A 

o 

v(l) 

=  < 

1 

1 

0 

0 

0 

0 

o 

V 

=  < 

1 

1 

1 

0 

1 

0 

o 

V 

=  < 

1 

1 

1 

1 

1 

1 

1  >. 

Each  output  vector  in  the  above  sequence  indicates  the  rooms  that  can  be  further  reached 
from  room-A.  For  example,  the  vector  x ^  indicates  that  we  can  get  into  rooms  B,  C  and 
E  from  room-A  because  the  vector  elements  which  correspond  to  these  rooms  are  set  to 
"1".  Since  the  vector  element  associated  with  room-G  is  set  in  x^\  we  conclude  that 
there  is  a  path  between  room-A  and  room-G.  The  superscript  of  x^ )  indicates  that  it 
takes  three  steps  to  reach  room-G  from  room-A.  The  time  needed  to  find  an  answer  to  a 
query  in  this  search  problem  is  independent  of  the  number  of  doors,  and  the  maximum 
number  of  vector-matrix  multiplications  (i.e.  in  the  worst  case)  is  proportional  only  to  the 
number  of  rooms  in  the  maze.  Note  that  with  this  approach,  an  infinite  loop  will  never 
occur.  For  an  arbitrary  graph,  this  search  method  always  gives  the  shortest  distance 
between  two  nodes.  But  the  actual  path  between  these  two  nodes  is  not  provided.  If  the 
path  information  is  desired,  we  have  to  actually  walk  down  the  graph  to  find  the  path, 
and  this  becomes  a  sequential  search  problem. 

The  above  example  illustrates  the  approach  employed  by  the  matrix  encoding 
method  for  solving  a  search  problem.  It  speeds  up  the  search  but  requires  extra  memory 
space  in  order  to  store  matrices.  Although  the  matrix  encoding  method  may  not  have 
problems  with  run-time,  it  may  run  into  combinatorial  explosion  in  space  when  dealing 


with  huge  search  problems.  There  is  essentially  a  trade-off  between  space  and  time 
requirements  in  solving  these  problems. 

5.  Optical  Architecture 

In  the  above  sections,  we  have  demonstrated  that  solutions  to  AI  expert  systems 
could  be  formulated  in  terms  of  simple  binary  matrix  operations.  These  operations 
include  vector-matrix  and  matrix-matrix  multiplication,  as  well  as  some  logic  operations. 

The  information  flow  in  matrix-algebraic  expert  systems  for  a  sample  query  is 
shown  in  Figure  3.  The  solution  y  is  formed  by  consecutive  vector-matrix  multiplica¬ 
tions.  The  fact  matrices  that  are  loaded  to  the  vector-matrix  multiplier  originate  directly 
from  the  knowledge  base  or  are  computed  by  matrix -matrix  multiplication  from  other 
fact  matrices  such  as  M2,  M3  and  M4.  Therefore,  an  optical  expert  system  architecture 
should  include  an  optical  memory  for  storing  the  fact  matrices,  optical  hardware  to  per¬ 
form  matrix  operations  and  an  electronic  micro-processor  to  control  the  information  flow 
(Figure  4).  The  microprocessor  also  stores  the  rules  in  the  form  of  matrix  algebraic  for¬ 
mulations  and  decides  upon  the  strategy  to  answer  the  query.  The  output  of  the  matrix- 
matrix  multiplier  is  thresholded  to  perform  the  logic  AND  operation  between  two  rela¬ 
tions.  The  2-D  logic  unit  implements  the  logic  OR  operation  between  two  relations  by 
performing  a  matrix-matrix  addition  followed  by  a  threshold  operation. 

To  answer  a  query  the  microprocessor  First  forms  an  appropriate  query  vector  which 
is  then  translated  into  optical  form  by  an  electronically  addressed  1-D  SLM.  Second,  the 
microprocessor  determines  the  required  linear  algebra  relations  and  their  order  of  execu¬ 
tion.  Then,  it  loads  the  appropriate  fact  matrices  from  the  optical  memory  and  issues 


commands  to  the  optical  hardware  to  perform  the  appropriate  operations.  Operations  that 
require  iterations  such  as  learning  are  performed  by  the  optical  hardware.  The  output  of 
the  optical  hardware  is  then  translated  into  electronic  form  by  a  1-D  detector  array  and 
the  result  is  presented  to  the  user.  In  certain  problems  the  microprocessor  can  operate  on 
the  output  of  the  optical  hardware  to  decide  on  further  action. 

For  example,  to  answer  a  query  given  by 

y  =  x-(C  +AB), 

the  fact  matrix  C  +A  B  has  to  be  generated  before  performing  the  vector-matrix  multipli¬ 
cation.  The  microprocessor  first  loads  the  matrices  A  and  B  from  the  3-D  memory  into 
the  matrix-matrix  multiplier  (see  Figure  4)  and  computes  the  product  AB,  which  is  then 
thresholded  and  stored  in  the  3-D  memory  temporarily.  Next,  the  2-D  logic  array  per¬ 
forms  the  OR  operation  on  matrices  C  and  A  B  that  was  recalled  from  the  3-D  memory. 
The  result  which  is  the  desired  fact  matrix  C+A-B  is  again  stored  in  the  3-D  memory. 
The  microprocessor  then  forms  the  query  vector  x  and  loads  it  into  the  1-D  SLM,  while 
the  fact  matrix  C+A  B  is  simultaneously  loaded  from  the  3-D  memory  into  the  vector- 
matrix  multiplier.  Finally,  the  answer  to  the  query  is  formed  at  the  output  of  the  multi¬ 
plier  and  detected  by  a  1-D  detector  array  and  analyzed  by  the  microprocessor. 


6.  Conclusions 


This  paper  described  an  expert  system  paradigm  based  on  a  matrix-algebraic  formu¬ 
lation  and  a  potential  opto-electronic  architecture  to  implement  this  new  paradigm.  Facts 
of  relations  are  encoded  in  matrices  or  tensors,  depending  on  how  many  objects  the  facts 
are  related  to.  All  the  rules  for  generating  new  relationships  and  for  learning  are  formu¬ 
lated  in  matrix  algebraic  form  and  are  performed  in  parallel  by  matrix -matrix  multipliers. 
The  inference  capability  can  be  achieved  simply  by  vector-matrix  multipliers,  making 
full  use  of  the  parallelism  and  connectivity  of  optics.  However,  applications  that  require 
facts  with  more  than  two  arguments  necessitate  a  matrix-tensor  multiplier.  The  com¬ 
parison  of  the  proposed  paradigm  with  sequential  Prolog  has  shown  significant  differ¬ 
ences  between  them  in  knowledge  representation  and  inference.  A  comparison  of  our 
matrix-algebra  based  paradigm  with  a  parallel  Prolog  running  on  a  multi-processor  will 
be  the  next  step  in  our  research.  A  maze  search  example  was  discussed  in  order  to  illus¬ 
trate  the  parallel  processing  nature  of  the  matrix  encoding  method,  which  offers  signifi¬ 
cant  gain  in  processing  speed  but  pays  a  price  in  the  space  required  to  store  large 
matrices. 
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Figure  4.  Architecture  of  an  opto-electronic  system 
for  the  implementation  of  matrix-algebraic  expert  sys¬ 
tem.  The  double  line  indicates  the  optical  path;  the 
solid  line  indicates  the  electronic  signal  path;  the 
dashed  line  indicates  the  electronic  control  simal 
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Abstract 

A  random  phase  coding  technique  is  utilized  to  optically  perform,  in  parallel,  a  matrix -tensor 
multiplication.  This  technique  allows  one  to  decrease  the  space  bandwidth  product  of  the  optical 
system  at  the  expense  of  a  decrease  in  the  system  dynamic  range.  The  analysis  of  this  trade-off 
shows  that  this  technique  has  advantages  over  the  conventional  techniques  based  on  space 
multiplexing,  and  therefore,  makes  it  possible  to  operate  on  large  size  2-D  arrays  of  data  using 
currently  available  real  time  materials. 


I.  Introduction 


Recently  many  areas  of  parallel  optical  computing  have  benefited  from  optical  vector-matrix 
multipliers,  such  as,  the  performance  of  discrete  Fourier  transforms  [1],  analog  computing  [2,3], 
programmable  optical  interconnection  [4],  optical  neural  computing  [5],  etc.  However,  many 
applications  require  the  manipulation  of  very  large  2-D  data  arrays,  which  will  essentially  require 
the  ability  to  perform  matrix-tensor  multiplication.  Some  attempts  at  solving  this  problem  have 
been  made  in  the  past  using  space  and  spatial  frequency  multiplexing.  These  conventional  matrix- 
tensor  multipliers  offer  wide  dynamic  range;  frequently  the  dynamic  ranges  are  wider  than  those 
available  from  the  Vidicons  and  the  CCD-cameras  (~  6  to  8  bits)  that  are  used  in  optical  systems. 
Some  optical  computing  architectures  (e.g.,  digital  computing  and  neural  computing  architectures) 
require  a  dynamic  range  of  only  3  to  5  bits.  On  the  other  hand,  they  require  an  extremely  largt 
space-bandwidth  product  (SBP)  for  the  optical  channel. 

In  this  letter  we  will  describe  a  matrix-tensor  multiplier  based  on  a  random  phase  coding 
process,  which  enables  us  to  reduce  the  SBP  requirements  of  the  optical  channel  at  the  expense  of 
the  dynamic  range  or  the  signal-to-noise  (S/AO  ratio  at  the  output.  We  will  discuss  the  SBP  and 
system  dynamic  range  trade-offs  in  light  of  the  fact  that  certain  parallel  optical  processors  have 
limited  dynamic  range  requirements. 

2.  Matrix -tensor  Multiplication  Based  on  Space  Multiplexing 

To  perform  matrix-tensor  multiplication  between  a  2-D  input  signal  (matrix),  g(x,y)  and  a 

fourth  rank  tensor,  W(x,y),  we  have  to  calculate  the  inner  products  of  the  function  g(x,y)  with  each 

fm-th  component  of  the  tensor  W(x,y),  where  f  =  1, 2, L  and  m  =  1,  2, ...,  M.  The  inner  product 

of  two  functions  can  be  determined  from  their  correlation  function  evaluated  at  the  origin. 

However,  to  perform  matrix -tensor  multiplication  in  parallel  we  have  to  compute  in  parallel  LM 

such  inner  products.  One  obvious  approach  has  been  to  spatially  multiplex  the  components  of  the 

L  M 

tensor  in  a  2-D  plane  (see  Fig.  la).  This  can  be  expressed  as  £  £  Wfm(x-fd,y-md),  where  d  is  at 

/=1  m=l 


least  equal  to  the  spatial  extension  of  the  components  of  the  tensor  W(x,y).  The  funcnon 


c(x,y)  =  g(x,y)©£  £  Wta(x-fd,y-md)  (1 

t=l  m=l 

will  consist  of  the  spatially  superposed  correlation  terms  g(x,y)©  Wfm(x-i'd,y-md),  where  © 
denotes  the  correlation.  At  the  coordinate  points  (fd, md)  this  function  provides  the  values  of  the 
desired  inner  products  (Fig.  lb).  Therefore,  implementation  of  a  matrix-tensor  multiplier  by  space 
multiplexing  will  require  an  optical  channel  of  SBP 

SBPmt  =  SBPmLM,  (2a 

where  SBPmt  is  the  SBP  of  the  channel  and  SBPM  is  the  SBP  of  the  signal.  For  example,  if  the 
matrix-tensor  multiplier  is  used  to  fully  interconnect  an  NxN  array  from  the  input  to  an  NxN  array 


at  the  output  (L=M=N),  a  channel  of 


SBPmt  =  SBPK!=N4 


will  be  required.  Such  a  large  SBPmt  is  required  in  order  to  (i)  spatially  multiplex  the  tensor 
components  and  (ii)  separate  the  value  of  the  inner  products  at  coordinate  point  (fd,md)  from  the 
sidelobes  of  the  neighboring  correlations.  To  overcome  such  large  SBP  requirements,  a 
holographic  approach  using  a  volume  material  of  R3  resolvable  points  capable  of  satisfying  the  N4 
requirements  where  N4  =  R3  has  been  suggested  [6].  In  this  paper  we  propose  to  employ  random 
phase  coded  optical  correlation  [7],  which  will  be  discussed  in  the  following  sections. 


3.  Matrix-tensor  Multiplication  Based  on  Random  Phase  Coding 

An  optical  correlator  with  the  same  random  phase  code  incorporated  into  the  two  functions  to 
be  correlated  provides  at  the  origin  of  the  output  the  inner  product  value,  while  the  energy 
associated  with  the  sidelobes  of  the  correlation  function  is  scattered  over  the  entire  output  plane. 

To  use  this  concept  in  implementing  a  matrix  tensor  multiplier,  one  can  employ  the  random  phase 
code  and  the  shift  theorem  as  described  in  the  following.  The  correlation  function  will  be  given  by 

c(x,y)  =  g(x,y)e^(x'y)  ©  h(x,y),  (3; 
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where  0(x,y)  is  a  random  phase  function  and 

h(x,y)  =  £  £  (4a) 

f=l  m=l 

Here  A  is  the  sampling  period  of  c(x,y)  and  the  shift  interval  of  the  tensor  components,  and  is 
defined  by 

A|K  <5;  (4b) 

Here  8  is  the  sampling  period  of  the  random  phase  process  and  K  is  the  number  of  random  phase 
samples  in  interval  A.  The  tensor  encoding  according  to  Eq.  (4)  is  shown  in  Fig.  2a. 

To  show  that  the  correlation  function  given  by  Eq.  (3)  provides  the  desired  output  of  the 
matrix-tensor  multiplier,  we  will  determine  its  expectation  values  (see  also  refs.  7-9): 

L  M 

E{c(x,y)}  =  £  £ 
f=l  m=l 

=  ZIcfe  P(x-fA,y-mA),  (5a) 

f=l  m=l 

where 

oo 

Qm  =  JJ  g(£  r]  -mA)Wfm  (g  -f A,  r)  -mA)d|  dq  (5b) 

— oo 

is  the  inner  product  of  the  input  function  and  the  fm-th  component  of  the  tensor  W(x,y),  E  denotes 
the  expectation  value,  P(x,y)  =  |  a(x,y)  | 2  and  a(x,y)  is  the  impulse  response  of  the  optical  system 
which  is  usually  a  real  function.  The  function  P(x,y)  describes  the  blurring  effect  due  to  the  finite 
bandwidth  of  the  channel.  For  an  ideal  optical  system  P(x,y)  is  a  delta  function.  Equation  (5a)  can 
be  interpreted  as  a  set  of  LM  pulses  spaced  at  a  distance  A,  while  the  amplitude  of  each  pulse  is 
equal  to  the  inner  product  given  by  Eq.  (5b)  (see  Fig.  2b).  To  satisfy  the  necessary  condition  to 
separate  and  to  resolve  the  inner  products,  we  will  require  the  spatial  width  of  the  function  P(x,y)  to 
be  narrower  than  5. 


JJ  g(£  A,  77  — mA)  (£  -f A,  q  -mA)d£  dq 


■  P(x-?A,y-mA) 


'wrumon 


*  ■**  iFHHVfn  iiinii  ««  m\M  i 


nuauvui 


-5- 


However,  due  to  the  fact  that  the  random  phase  coding  process  is  used  to  reduce  the  SBP 
requirements  we  are  also  introducing  a  noise  term  to  the  output,  which  will  reduce  the  output  S/N 
ratio.  The  intensity  (S/N)  ratio  can  be  defined  as 


(S/AOl  £ 


E{c(x,y)})  l2 
(Var  {c(x,y)))'/j  J 


(6a) 


The  S/N  ratio  of  Eq.  (6a)  can  be  employed  in  evaluating  the  dynamic  range  of  the  system, 
which  is  defined  as  the  output  ratio  of  the  maximum  value  of  the  signal  to  the  maximum  value  of 
the  noise.  The  resultant  dynamic  range  D  (see  Appendix  and  refs.  7-9)  is  given  by 


4K2SBPm 

LM 


(6b) 


The  relation  given  in  Eq.  (6b)  has  been  obtained  under  the  assumption  that  the  functions  g(x,y)  and 
Wfm(x,y)  are  real  and  normalized. 

Applying  the  matrix-tensor  multiplier  to  perform  the  functions  of  a  fully  interconnected 
network  (L=M=N,  SBPM  =  N2) 

D  =  4K2.  (6c) 

The  phase  coded  matrix-tensor  multiplier  will  require  an  optical  channel  SBP  given  by 

SB?m'  =  K2[^SB^+(L-l))[^SB?^+(U~l)]  (7a) 

Again  for  our  example  of  a  fully  interconnected  network  (L=M=N,  SBPm  =  N2)  we  obtain 

SBPmt'  =  4K2SBPM  =  4K2N2-  (7b) 

Comparing  Eq.  (2a)  with  (7a),  one  can  conclude  that  the  SBP  requirements  of  the  channel  using  a 
phase-coded  matrix-tensor  multiplier  are  smaller  than  the  ones  using  pure  space  multiplexing.  For 
the  example  of  a  fully  interconnected  network  the  reduction  in  the  channel  SBP  is  given  by 

SBPmt  N2 


SBPmt'  4K2 ' 


(8) 
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The  matrix-tensor  multiplier  based  on  space  multiplexing  requires  a  large  SBP  (Eq.  2),  but 
offers  very  large  dynamic  range  at  the  output  (e.g.,  D  >  N2).  The  matrix-tensor  multiplier  based  on 
random  phase  coding  will  require  less  SBP  (Eq.  7)  at  the  expense  of  the  dynamic  range  (Eq.  6). 
Therefore,  there  exists  a  trade-off  between  the  available  SBP  of  the  channel,  and  the  dynamic  range 
required  by  a  specific  optical  system.  To  illustrate  these  trade-offs  we  will  give  two  examples, 
where  the  limiting  elements  of  the  SBP  of  the  optical  channel  are  the  nonlinear  materials  in  which 
the  correlations  are  performed.  The  two  types  of  nonlinear  materials  are  the  planar  (e.g.,  2-D 
holographic  materials)  and  the  volume  (e.g.,  3-D  photorefractive  crystals  or  volume  holographic 
materials).  We  will  assume  that  the  planar  and  the  volume  materials  will  be  capable  of  supporting 
an  optical  channel  with  a  SBP  of  R2  and  R3  respectively.  In  our  examples  we  will  also  assume  a 
fully  interconnected  network,  L=M=  -^SBP^  =  N,  i.e.,  the  N2  inputs  are  connected  to  the  N2 
outputs  via  the  N4  connections  of  the  fourth  rank  tensor.  For  a  planar  material,  the  maximum  size 
of  the  input/output  arrays  for  conventional,  (Nc)  and  phase  coded,  (Np)  matrix-tensor  multiplication 
will  be  given  by 


(9a) 


N  =  = 
p  2K  2VD- 


respectively.  The  plots  comparing  the  two  result  of  Eqs.  (9)  are  shown  in  Fig.  3  in  a  log-log  scale. 


Similarly,  for  a  volume  material  we  obtain 


Nc  =  R3/4 


(10a) 


ND  =  — - 

p  2VD 


(10b) 


The  comparison  plots  for  a  volume  material  are  shown  in  Fig.  4.  One  can  clearly  observe  from 
Fig.  3  and  Fig.  4  that  there  is  a  trade-off  between  the  dynamic  range  of  the  multiplier  and  the  size  of 


as 


-  7  - 


,%V 


the  array  at  which  the  system  can  be  reliably  operated.  For  example,  for  a  D  =  100  and  planar 
material  we  will  be  better  off  using  the  phase  coded  technique  for  input/ourput  arrays  larger  than 
(20x  20)  pixels.  Another  way  of  observing  the  trade-off  is  to  note  that  in  order  to  operate  on  an 
array  of  1000  x  1000  pixels  at  D  =  100  using  phase  coding,  we  will  need  a  planar  material  of  SBP 
of  only  2104x2T04  pixels  as  opposed  to  106xl06  pixels  using  the  conventional  technique. 
Furthermore,  a  volume  material  will  enhance  even  more  the  advantages  of  the  phase  coded 
technique  over  the  conventional  one.  For  example,  to  operate  on  an  array  of  1000  x  1000  pixels  at 
D  =  100  a  volume  material  will  require  SBP  of  lO^xlO^xlO3  for  the  phase  coded  technique  and 
104xl04xl04  for  the  conventional  technique,  respectively. 

5.  Conclusions 

We  have  shown  that  the  random  phase  coded  technique  is  very  useful  in  computing  matrix- 
tensor  operations  because  it  allows  us  to  operate  on  larger  matrix  arrays  for  a  given  SBP  of 
nonlinear  material  in  numerous  optical  signal  processing  applications.  The  analysis  of  the  trade-off 
between  the  available  SBP  and  the  output  dynamic  range  shows  that  it  is  possible  to  construct 
systems  with  available  real  time  holgraphic  materials  (e.g.,  photorefractive  materials,  organic 
materials,  etc.)  for  multiplication  of  large  2-D  arrays  of  data  with  a  fourth  rank  tensor  in  real  time. 
Systems,  for  which  the  dynamic  range  of  D  =  100  is  quite  sufficient,  are  of  high  importance  in  the 
areas  of  neural  optical  computing  and  reconfigurable  optical  interconnects  for  digital  optical 
processing  applications. 
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In  this  appendix  we  will  study  the  phase  coded  technique  by  analyzing  the  S/N  ratio  at  the 
output  defined  by  Eq.  (6a).  For  simplicity  we  will  conduct  the  analysis  for  a  one-dimensional  case. 


The  S/N  ratio  of  the  amplitude  of  c(x)  is  defined  by 

(S/N)a  = - -1-— } - ^—y  (A. 

(Var  {c(x)))/2  (E{(c(x)-E{c(x)))“))/j 

where  E  denotes  the  expectation  value,  E{c(x)}  is  the  first  moment  and  the  variance  is  determined 
from 


Var  {c(x)|  =E{(c(x)-E(c(x)})2} 

=  E{c2(x)}-(E{c(x)})2  (A.2) 

To  estimare  the  (S/N)  ratio  we  therefore  have  to  determine  the  first  and  the  second  moments  of  the 
correlation  function  c(x). 

First  moment 

The  correlation  function  of  eqs.  (3)  and  (4)  can  be  rewritten  in  an  alternative  form 


c(x)  =  g(x)  e^(x) 

=  g(x)e*w 


L 

*  L  Wf*(x-fA)e'J^A)  ©  P(x) 
f=i 


5(y—fA)  (x-y)e 


dy 


®P(x) 


(A.3) 


where  P(x)  =  |  a(x)  | 2  and  a(x)  is  the  impulse  response  of  the  optical  system  and  is  a  real  function. 
Calculating  the  first  moment, 


E(c(x))  =  E- 

^  oo  oo 

£  j  dy  J  ds  <5(y-?A)  Wj  (s-y)e“^(s'y)  g(s-x)e^(s_x) 

@P(x) 

f=l  —  — 

(A.4) 


j 
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Under  the  assumption  that  the  phase  <*>(x)  is  a  random  variable  uniformly  distributed  in  the  interval 
[-;r,  ;r},  the  last  equation  can  be  rewritten  as 

^  OO  OO  OO 

E|c(x))  =  V  |  dy  J  ds  J  dz  <5(y-?A)  Wf’(x-y)g(s-z) 

f=  [  — OO  — OO  — OO 

<5(z-y)  P(z-x)  (A.5) 

where  we  employed  the  relation  [10] 

E  { e-J0(s"y)  e )  =  S(x-y)  (A.6) 

Finally  the  equation  (A.5)  can  be  written  as 

L 

E{c(x)}  =  £  P(x-?A)< 

M 

. 

The  last  relation  can  be  interpreted  as  a  set  of  L  pulses  spaced  at  a  distance  A,  while  the  amplitude 
of  each  pulse  equals  to  the  inner  product  between  the  input  signal  s(x)  and  the  f-th  component  of 
V^x).  The  term  P(x-fA)  describes  the  blurring  effect  due  to  the  finite  channel  bandwidth  (ideally 
P(x)  would  be  a  5- function  if  the  channel  bandwidth  were  infinite).  To  separate  spatially  the  inner 
products  we  have  to  satisfy  the  condition  that  the  spatial  extension  (width)  of  the  function  P(x)  is 
much  smaller  than  the  sampling  distance,  A. 

Second  moment 

The  second  moment  is  determined  from  the  correlation  function  c(x) 

E{c2(x)}  =E{c(x1)c*(x2)}|X]=X:=*  (A.8) 

The  correlation  function  c(x)  is  given  by 


j  Wf*(s—?A)g(s  — ?A)ds 


(A.7) 


-  10- 


E{c(xx)c*(x2))  = 


L  L 


y  £  JJ  dyjdsi  <5(yx  -fjA)  ‘(sj  -yj)g(si  -Xx). 


1\-\  h* 


■  e 


-jp(si-yi>  eje(s.-x,)  [jdy2dS2  «5(y2-f2A). 


•  Wf3(s2-y2)g,(s2-x2)eJ0(S3-yj)e-j0(Sj"Xj)  ®  P(x, )P*(x2).  (A.9) 


Using  the  relation 


E  {e_J’l,)(Si_yi)  e^(Si-Xi)  g-jx^-y^)  j 

=  <5(yx  -xx)  <5(x2  -y2)+  <5(s2  -si  +yi  ~y2)  1  -s2  +x2  ~xi) 


(A.10) 


Eq.  (A.9)  can  be  rewritten  as 


E{c(Xx)c(x2)}  =Ji+J2 


(A.11) 


where 


and 


Jx  =  {  •  •  •  5(yx  -xx)  <5(x2-y2)  ‘ ' '  )  ®  P(xi)P*(x2) 


J2  =  {  •  •  •  5(s2-sx  +yx  -y2)  5(sx  -s2+x2  -xx)  •  •  •  )  ©  P(xi)P  (x2) 
Evaluating  the  integrals  in  terms  Jx  and  J2  we  obtain: 


- 11  - 


J1  =  IIP(xi-fiA)P*(x2-f2A)  j  dsjW^sj-fjA). 

il*l  (ui 


•glsj-fjA)  j  ds2  Wfj(s2 -?2A)g*(s2 -f;A) 


L  L 


J;=  J  dZj  X  I  J  ds1Wri*(s1-fIA)g(s1-zl)Wf;(s1-f1A) 

ft=i  t;=i 


■  g  (Si  -zi)P(zi-x1)P’(z1  -(f2-fi)A-x2) 


Substituting  xj  =  x2  =  x  the  last  equations  can  be  rewritten  as 


L  L 


Ji  =  I  E  P(x - ^ A) P* (x  —  f2 A)  J  dSl  W^Csj-^A) 

^2=1  “00 


g(s1-/IA)  j  ds2  Wrj(s2  -fr2A)g*(s2  -Jf2A). 


L  L 


J2=EI  j  ds1w;i(s1-f1A)Wfj(s1-f1A) 

fl.l  f2»l  -00 


Assuming  P(x)  to  be  a  narrow  function  we  obtain; 


f11 

P(x-fA)P  (x-f2A)  =  jQ 


(p(x-f'A)i2  h=h=r 


h*h 


and 


f|P(Zl-x)|2  h=h=!' 

P(z1-x)P*(z1-x  +  (f2-?i)A)=j0  h*h 


L 


Substituting  these  last  relations  into  Jj  and  J2  we  obtain 


(A.  12a) 


(A.  12b) 


(A.  13a) 


J  dz1g(si-zi)g*(s1-z1)P(z1-x)P*(zi-x+(f2-fi)A)  (A.  13b) 


(A.  13c) 


(A.  13d) 


-  12- 


L 

Ji  =  x  |P(x-f'A)|2|  J  w;(s-rA)g(s-f'A)ds|2  (A. 14a) 

t'=  l 

J:=I  JJdzidsi|Wr(s,-f'A)|2|g(s1-z1)|2|PUi-x)|:  (A.14b) 

f=i 

To  evaluate  the  variance  given  by  Eq.  (A. 2)  we  first  calculate  the  second  term  E|c(x)))-  using 
the  result  of  Eq.  (A. 7), 


I  E{c(x)}  | 2  = 


L 

«■  "N 

OO 

2 

V  P(x-fA> 

I  W,(s-fA)g(s-fA)ds 

frl 

L  L 

=  X  Z  P(x  -  f i  A)  P*(x  -  ?2  A)-1 

f,=i  f2= l 


' 

oo 

J  Wfj(s-f2A)g*(s-?2A)ds  - 


J  w;i(s-fiA)g(s-f1A)ds  \ 


=  |  P(x  -  f  A  | ' 


j  wr(s-rA)g(s-rA)ds 


(A.15) 


where  we  have  used  the  result  of  Eq.  (A.13c)  with  P(x)  being  a  narrow  function.  Comparing  (A.15) 
with  Ji  from  Eq.  (A.  14a)  the  variance  from  Eq  (A.  2)  can  be  determined  as 

Var  {c}=J2.  (A.  16) 

Considering  again  that  the  function  P(z  -x)  is  much  narrower  than  g(x),  we  evaluate  the  term 

J2  as 


-  13  - 


**:.**! 


Var  {c(x)}=  V  j  ds,  | Wr(s, 
r=i  — 


J  dz,  is'.Si  —  Zi )  1 2  !P(zi  -x)|2 


=  I  j  ds1|Wr(s1-f'A)|:|g(s1-x)|2  J  |P($)|2d=  (A.17) 


where  v  is  the  width  of  P(x). 


We  are  interested  in  evaluating  the  S/N  ratio  at  a  point  x  =  f  A,  and  therefore  we  evaluate  the 


variance  of  c(x)  at  these  locations, 


Var  {c(x=fA)}=  £  J  ds  |  Wr(Sl -|T'A)  |2  |g(Sl -?A)  |2 


v/2 

J  |P(7])|2dTJ 

-v/2 


(A.  18) 


The  S/N  ratio  can  be  employed  in  evaluating  the  dynamic  range  of  the  system,  which  is 


defined  as  the  output  ratio  of  the  maximum  value  of  the  signal  to  the  maximum  value  of  the  noise. 


The  maximum  value  of  the  first  moment  at  a  location  x  =  fA,  will  be  determined  by 


E{c(x)}=X 


(A.  19) 


where  X  is  the  spatial  extension  of  the  input  information. 


The  maximum  value  of  the  variance  at  the  origin  is  given  by 


Var  (c(0) }  =  v  £  ^?'  =  v^(L+l) 

r= i  L  1 


(A.20) 


or  at  any  x  =  f. A 


W  t'-O 

Var  {c(x=fA))=vX  £  V1 


(A.21) 


; 


-  14  - 


£ 


The  variance  reaches  its  maximum  at  the  origin,  x  =  0,  and  therefore  the  amplitude  dynamic  range, 
Da  will  satisfy  the  following  inequality 


Da  > 


(A. 22) 


^6j(L+l) 

where  we  have  assumed  that  the  sampling  period  of  the  phase  process,  8  is  equal  to  the  width  v  of 
the  function  P(x).  Considering  the  relations 

A  =  <5K 


and 


pnn  X 
SBPm  =  - 


the  dynamic  range  of  eq.  (A.21)  can  be  rewritten  as 


Da 


2 SBPM  K 


Furthermore,  the  dynamic  range  of  the  intensity  D,  for  a  2-D  case  will  be  given  by 


D> 


4  SBPm -K2 
LM 


(A.23) 
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Figure  Captions 

Fig.  1.  (a)  Representation  of  the  tensor  by  space  multiplexing.  The  components  of  the  tensor 
are  space-multiplexed  with  a  period  d,  where  d  is  equal  to  or  larger  than  the  spatial 
extension  (NA)  of  the  tensor’s  components,  Wfm(x,y). 

Fig  l  (b)  The  output  of  matrix-tensor  multiplication  based  on  the  space  multiplexing 
techniques. 

Fig.  2.  (a)  Representation  of  the  tensor  by  random  phase  coding.  The  components  of  the  tensor 
Wfm(x,y)  of  spatial  extension  (NA)  are  multiplied  by  a  random  phase  code  which  has 
a  pixel  resolution  of  8.  The  tensor  components  are  shifted  with  respect  to  each  other 
with  a  period  A  =  K6  and  then  superimposed  on  one  another. 

Fig.  2.  (b)  The  output  of  matrix-tensor  multiplication  based  on  the  random  phase  coding 
technique. 

Fig.  3.  Comparison  of  phase  coded  and  conventional  matrix-tensor  multiplication  using 

planar  material.  R2  is  the  available  space  bandwidth  product  (SBP)  provided  by  the 
real-time  nonlinear  material  (RTNM);  N2  is  the  size  of  the  input/output  2-D  array. 
To  operate  on  a  matrix  of  1000x1000  the  conventional  method  will  require  a  SBP  of 
106xl06  from  the  RTNM,  while  the  phase  coded  M-T  multiplier  will  require  only  a 
SBP  of  2-104x2-104  for  D  =  100  and  6103x6103  for  D  =  10  from  RTNM. 
Alternatively,  given  a  SBP  of  1000x1000  for  the  RTNM,  the  conventional  M-T 
multiplier  can  accomodate  a  matrix  of  32x32,  while  the  phase  coded  M-T  multiplier 
will  be  able  to  accomodate  a  50x50  matrix  for  D  =  1 00  and  160x160  matrix  for  D  = 
10. 

Fig.  4.  Comparison  of  phase  coded  and  conventional  matrix-tensor  multiplication  using 

volume  material.  R3  is  the  available  space  bandwidth  product  (SBP)  provided  by 
real-time  nonlinear  material  (RTNM);  N2  is  the  size  of  the  input/output  2-D  array. 
To  operate  on  a  matrix  of  1000x1000  arrays  a  conventional  method  will  require  a 
SBP  of  104xl04xl04  from  RTNM,  while  the  phase  coded  multiplier  will  require  a 
SBP  less  than  103xl03xl03  for  D  =  100  and  a  SBP  of  less  than  400x400x400  for  D 
=  10  from  RTNM. 
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Fig.  1.  (a) 


Representation  of  the  tensor  by  space  multiplexing.  Tire  components  of  the  tensor 
are  space-multiplexed  with  a  period  d,  where  d  is  equal  to  or  larger  than  the  spatial 
extension  (NA)  of  the  tensor’s  components.  Wfm(x.v), 


Fig  1.  (b) 


The  output  of  matrix-tensor  multiplication  based  on  the  space  multiplexing 
techniques. 


% 1 

,  ✓ 
* 

o 

o 

V 

_ 

\v 

2\  Hr 


•  i  CC 

u  t 

d.  "  ■=  z, 

«  5  ^  £ 

5  C.  .  O 

S  = 

«^2o 
«  Sr- 
£  eLo£  ii 

.2  •=  K  Q 

fN  y  ^ 

C*  £  s  £ 

.  ttr  Or 

£  I®  £ 


fN  y  ^ 
06  £  S  £ 
.  'tr  Or 

|  Is 'S 

p  «j  x%, 
u  X>c 
H  -  O  T 
«  .!£  -«  O 
re^  'S  *=> 

S 

n  o 
=  S«o 

«  -y  ffi  ”* 


c  w<  _  • 

C3  <N  fs  ^3  ■ 

s 

“  n  o  l 

-  z  «  —  : 

C  H  s  11 : 

.1  £-3  Q 

§  5 1"  i  •. 

C.  «  5^, 

Sgi? 

3  5  _  <N 

r*  U  V 

c  b  o  * 

p  W  P:  O  . 

o  C  w  — >  • 
c  *p  £  <s  * 

■H  5  "a  *p  ^ 
k  c  c  -  L 
•E  «  o  Sr  f 
~  cpo  t 
2  .a  c  in 

=  4  >  «  ■ 
i»5^ 

5  «  p  v 

•2  «  o>  o  c 

-  ~  -  u  : 

>  ?o  3  • 

c  o  cr  . 
o  ■a  ©  «  c 
u  u  —<  w  c 
t;  J2  X  ©  = 

1  >  S  *2  ■ 

8  C  $  ^  ' 
—j  p  O  ui 

«  jrr  .2  ( 

*gg  o3.{ 

uO 

O  w  ‘u  3 

re  —  c5  E 

^U3r 

^L,  3  -  PT  . 
0  ■=  «  «5 

o  2  c  ^ 
e  o,  o  -a  . 
O  *-  O  *> 

•q  "3  2  ° 
d._s  a.  w 

P  w  Q  t/5 

s  ip -■ 

Uit-  f 


If  . 

Cw  « 

C  <N  2 

i-  rc ; 

ii  x  II 

<  £i  3 


